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AUDIO PLA YB ACK/Rfe CIRCUIT 
WITH FILTER CO-PROCESSOR 

5 BACKGROUND OF THE INVENTION 

1. TECHNICAL FIELD OF THE INVENTION 

This invention relates generally to portable electronic equipment and more 
particularly to a multi-function handheld device supporting audio playback and recording 
operations. " A : " 

10 2. DESCRIPTION OF RELATED ARTrpP .' 

As is known, integrated circuits, are used in a wide variety of electronic 

equipment, including portable, or handheld, devices. Such handheld devices include 

• . .. : .- '•4:.i:v\ : i-:;; , .t Im- 

personal digital assistants (PDA), CD players; MP3 players, DVD players, AM/FM radio, 

a pager, cellular telephones, computer memory ; extension (commonly referred to as a 

1 5 thumb drive), etc. , Each of these Handheld devices includes one or more integrated 

circuits to provide the functionality of the device. For example, a thumb drive may 

include an integrated circuit for interfacing ,\yith a computer (e.g., personal computer, 

laptop, server, workstation, etc.) : via one, of the ports of the computer (e.g., Universal 

Serial Bus, parallel port, etc.) and at; least one other memory integrated circuit (e.g., flash 

20 memory). As such, when the thumb' drive is - cpUpled to a computer, data can be read 

from and written to the memory of the Ihunib drive. Accordingly, a user may store 

personalized information (e.g., presentations, Internet access account information, etc.) 

on his/her thumb drive and use any eomputep to. access the information. 

As another example, an Mf3 player may include multiple integrated circuits to 

25 support the storage and playback t;of ^digitally formatted audio (i.e., formatted in 
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accordance with the MP3 speci fication). As is known, one integrated circuit may be used 
for interfacing with a computer, another integrated circuit for generating a power supply 
voltage, another for processing the : , storage and/or playback of the digitally formatted 
audio data, and still another for rendering . the playback of the digitally formatted audio 
5 data audible. r ' \ P/':/ • . . • 

Integrated circuits have enabled the creation of a plethora of handheld devices, 
however, to be "wired" in today's ejectromc world, a person needs to posses multiple 
handheld devices. For example, one^jm.i^owni^eellular. telephone for cellular telephone 
service, a PDA for scheduling, address hook, etc., one or more thumb drives for extended 

10 memory functionality, an MP3 player for storage and/or playback of digitally recorded 
music, a radio, etc. Thus, even though a single handheld device may be relatively small, 
carrying multiple handheld devices on one's person can become quite burdensome. 

The above-described handheld devices are often used in a non-tethered mode in 
which they are solely battery powered, i The^available energy available from the battery 

15 is, of course, limited. Thus, it is desirable, Tor the integrated circuits servicing the 
handheld device to consume as little /power as possible while adequately performing 
required functions. Powering a ^pracessor ; such as a Digital Signal Processor has 
historically been required to service /all operations of the handheld device, which 
consumes significant power. The processor ,1s underutilized during most operations but 

20 continues to consume significant ^po^^^: 7 1 Further^ in other operations the processor 
becomes overloaded with basic processing functions, e.g., filtering operations, such that it 
is unable to service all desired functions'. 
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Thus, a need exists for a h^dh^l^de^i^.^d an integrated circuit servicing such 
a handheld device that performs necessary processing functions while extending battery 

life.. : . . • " 

5 BRIEF SUMMARY OF THE INVENTION 

An integrated circuit (and method of operation) used in an audio playback device 
includes a host interface, a processing nip module, a memory, and a 

filter co-processor. The processing module operably couples to the host interface and the 
multimedia module operably couples to the processing module. The memory operably 

10 couples to the processing module and to the multimedia module in which digital audio 
information is stored. The filter co-processor operably couples to the processing module 
and to the memory, wherein at the direction of the processing module the filter co- 
processor retrieves digital audio information from the memory and filters the digital 
audio information. ; ;,- .-';/;• ' 

15 In one embodiment, the fi Iter .cq-processor includes a plurality of programmable 

registers operably coupled to the processing-module and a Direct Memory Access (DMA) 
engine operably coupled to the memory; and to* the plurality of programmable registers. 
The filter co-processor also includes a pluralityvpf coefficient register files operably 
coupled to the DMA engine, a plurality of sample register files operably coupled to the 

20 DMA engine, a Multiply Accumulatoi; (MAG) engine operably coupled to the plurality of 
programmable registers, the plurality;; of coeft icient register files, and the plurality of 
register files, and an accumulator operably coupled to the MAC engine and to the DMA 
engine. H\ ; v ' .;. ,, 
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The integrated circuit operates in: various modes. In a playback mode, the filter 
co-processor, at the direction of the processing module, retrieves the digital audio 
information from the memory, filters the digital audio information to produce filtered 
digital audio information and writes The filtered digital audio information to the memory. 
5 Further, the multimedia module receives the filtered' digital audio information from 
memory and converts the filtered digital audio information to a playback format. In the 
playback mode, the filter co-processor may. perform interpolation filtering on the digital 
audio information to produce the filtered; digital audio information. The filter co- 
processor may also perform graphic equalization filtering on the digital audio information 

10 to produce the filtered digital audio information. In performing graphic equalization 
filtering on the digital audio information, the-filter' co-processor may perform one of 
subtractive graphic equalizer filtering in a cascade mode or additive graphic equalizer 
filtering in a parallel mode. - 

In a recording mode the multimedia moclule receives incoming audio information, 

15 converts the incoming audio i n formation; to .incoming digital audio information, and 
writes the incoming digital audio , information: to memory. Further, in the recording 
mode, the filter co-processor, at the.directioiv ,of the processing module, retrieves the 
incoming digital audio information from the? memory, filters the incoming digital audio 
information to produce filtered incoming digital i.audio information and writes the filtered 

20 incoming digital audio information to the memory:-* The filter co-processor may perform 
decimation filtering on the incoming digital vaudi() information to produce the filtered 
incoming digital audio information. 
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The integrated circuit may: ^SQ"ynel^d^,;iclock control circuitry that varies the 
frequency of a clock provided to the filter co-processor to thereby adjust the rate at which 
the filter-co-processor filters the digital audio information. In this structure, the clock 
may also provided to the processing. module: with the clock control circuitry also varying 
5 the frequency of the clock provided to the processing module. By varying the clock to 
the components of the integrated circuity , the processing power of the integrated circuit is 
tailored to meet its processing demands.y Whgii. processing demands are less, the clock 
frequency is reduced to reduce power consumption. Alternately, when processing 
demands are greater the clock frequency is increased to meet the processing demands. 

10 The integrated circuit may also, include voltage control circuitry that varies a 

supply voltage provided to the filter co-processor. The voltage control circuitry may also 
provide and vary the supply voltage provided to the filter co-processor. By controlling 
the voltage provided to some or all of the .components of the integrated circuit, power 
consumption of the integrated circuit , is - reduced while still meeting the processing 

1 5 requirements of the integrated circui t. ; - > 

During its operations, the integrated .circuit may be required to execute a context 
switch operation. In a context switclr operatipn,vthe filter co-processor receives a context 
switch operation from the processing module,, ceases its current filtering operations, and 
initiates differing filtering operations. ; in performing the context switch, the filter co- 

20 processor may save a state of the current filtering, operations to memory. 

Other features and advantages^ of the .present invention will become apparent from 
the following detailed description of the invention made with reference to the 
accompanying drawings. : V . 
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BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS 

Figure 1 is, a schematic block diagram of a handheld device and corresponding 
integrated circuit in accordance with an embodiment of the present invention; 
5 Figure 2 is a schematic block diagram of another handheld device and 

corresponding integrated circuit in accordance, with an embodiment of the present 
invention; ■ ; ■ 

Figure 3 is a schematic block diagram of another integrated circuit in accordance 
with an embodiment of the present invention; 
10 Figure 4 is a schematic block diagram illustrating a portion of the integrated 

circuit of Figures 1 -3 constructed according to an embodiment of the present invention 
illustrating in particular the structure of a filter co-processor and its interaction with the 
processing module; , t . , 

Figure 5A is a block diagram ill ustrating, audio capture and storage operations; 
15 Figure 5B is a block diagram: illustraling^audio playback operations; 

Figure 5C is a logic diagram .illustrating operation of the Filter Co-Processor 
, (FILCO) of Figure 4; . ^V^^:^^.^,;, 

Figure 6 is a. logic diagram illustrating^ interaction with the FILCO of 

Figure 4; 

20 Figure 7 A is a logic diagram illustrating Finite Impulse Response (FIR) filtering - 

operations of the FILCO of Figure 4;f ;i : /Y : : - 

Figure 7B is a logic diagram illustratihg Infinite Impulse Response (II R) filtering 
operations of the FILCO of Figure 4^; : ^- 
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Figure 8 A is a block diagram illustrating one structure of a FIR filter employed by 
the FILCO of Figure 4; dt" L> %i . 

Figure 8B is a block diagranliillustratirig one structure of an IIR filter employed 
by the FILCO of Figure 4; V • ' - ^V 

5 Figure 9 is a block diagram illustrating rllR filtering operations of the FILCO of 

Figure 4 in a cascade mode of operation; and 

Figures 10 is a block diagram illustrating IIR filtering operations of the FILCO of 
Figure 4 in a parallel mode of operation.: . ;~ 

10 DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 is a schematic block diagram of a multi-function handheld device 10 and 
corresponding integrated circuit 12 operahly coupled to a host device A, B, or C. The 
multi-function handheld device 10 also includes memory integrated circuit (IC) 16 and a 
battery 14. The integrated circuit 12, includes a. host interface 18, a processing module 

15 20, a filter co-processor (FILCO) 31, a memory interface 22, a multimedia module 24, a 
DC-to-DC converter 26, and a bus :28.\v /The multimedia module 24 alone or in 
combination with the processing module 20 and/or the FILCO 31, provides the functional 
circuitry for the integrated circuit 12. The FILCO, 3 1 and its operations will be described 
in detail with reference to Figures 4- 10: . The .DC-to-DC converter 26, which may be 

20 constructed in accordance with the teaching o^ 6,204,651, entitled METHOD 

AND APPARATUS FOR REGULATING A' DC VOLTAGE, provides at least a first 
supply voltage to one or more of the host interface 18, the processing module 20, the 
multimedia module 24, the memory^ interface- 22, and the FILCO 31. The DC-to-DC 
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converter 26 may also provide Vp6^^^6^P : more of the other components of the 
handheld device 10. ,. r , -u'<^\ 

When the multi-function handlieldM is operably coupled to a host device 

A, B, or C, which may be a personal computer, workstation, server (which are 
represented by host device A), a laptop.; computer (host device B), a personal digital 
assistant (host device C), and/or any other device that may transceive data with the multi- 
function handheld device 10, the processing: module 20 performs at least one algorithm 
30, where the corresponding operational instructions of the algorithm 30 are stored in 
memory 1 6 and/or in memory incorporated in. the processing module 20. The processing 
module 20 may be a single processing device or a plurality of processing devices. Such a 
processing device may be a microprocessor^ micro-controller, digital signal processor, 
microcomputer, central processing unit, field programmable gate array, programmable 
logic device, state machine, logic circuitry, analog circuitry, digital circuitry, and/or any 
device that manipulates signals (analog and/oridigital) based on operational instructions. 
The associated memory may be a single memory device or a plurality of memory 
devices. Such a memory device may, be: a read-only memory, random access memory, 
volatile memory, non-volatile memoryV static memory, dynamic memory, flash memory, 
and/or any device that stores digital information; Mote that when the processing module 
20 implements one or more of its . functions , via. a state machine, analog circuitry, digital 
circuitry, and/or logic circuitry, the . associated memory storing the corresponding 
operational instructions is embedded with the circuitry comprising the state machine, 
analog circuitry, digital circuitry, and/pr Jogic. circuitry. 
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With the multi-function handheld device 10 in the first functional mode, the 
integrated circuit 12 facilitates the transfer of data between the host device A, B, or C and 
memory 1 6, which may be nonvolatile -memory (e.g., flash memory, disk memory, 
SDRAM) and/or volatile memory (e.g., DRAM). In one embodiment, the memory IC 16 
5 is a NAND flash memory that stores both data and the operational instructions of at least 
some of the algorithms 30. , 

In this mode, the processing module ;-20 retrieves a first set of operational 
instructions (e.g., a file system algorithm, which is known in the art) from the memory 16 & 
to coordinate the transfer of data. For example; data received from the host device A, B, "■V-.f 

10 or C (e.g., Rx data) is first received via the host interface module 18. Depending on the w, 
type of coupling between the host device and, the handheld device 10, the received data 
will be formatted in a particular manner. For, example, if the handheld device 10 is 
coupled to the host device via a USB cable, the received data will be in accordance with 
the format proscribed by the. USB sp^cifica.ton^i The host interface module 18 converts -^m 

15 the format of the received . data (e.g., USB: format) into a desired format by removing v. 
overhead data that corresponds to the format x>f the received data and storing the • '•' ' <m 

remaining data as data words. The sizerof- the .data words generally corresponds directly - . : : ! r 

to, or a multiple of, the bus width of bus 28 and the word line size (i.e., the size of data 
stored in a line of memory) of memory; 16. Under the control of the processing module 

20 20, the data words are provided, via the ^memory -interface 22, to memory 16 for storage. 
In this mode, the handheld device. 1Q is functioning as extended memory of the host 
device (e.g., like a thumb drive). r • - :); -.\, ;.. 
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In furtherance of the first functional mode, the host device may retrieve data (e.g., 
TX data), from memory 16 as if the. memory were part of the computer. Accordingly, the 
host device provides a read command to , the handheld device 10, which is received via 
the host interface 18. The host interface 18 converts the read request into a generic 
5 format and provides the request to the processing module 20. The processing module 20 
interprets the read request and coordinates the retrieval of the requested data from 
memory 16 via the memory interlace 22. Ilie retneved data (e.g., TX data) is provided to 
the host interface 1 8, which converts : the format of the retrieved data from the generic 
format of the handheld device 10 into -the 'format of the coupling between the handheld 

10 device 10 and the host device. The host interface 18 then provides the formatted data to 
the host device via the coupling. . ". ■ * \- ; • 

The coupling between the host device and the handheld device 10 may be a 
wireless connection or a wired connection. For instance, a wireless connection may be in 
accordance with Bluetooth, IEEE 802.1.1(a); (b) or (g), and/or any other wireless LAN 

15 (local area network) protocol, IrDA, etc. The wired connection may be in accordance 
with one or more Ethernet protocols,; Fire wire, USB, etc. Depending on the particular 
type of connection, the host interface, module 18, includes a corresponding encoder and 
decoder. For example, when the handheld/device 10 is coupled to the host device via a 
USB cable,- the host interface m o d u 1 e 1 8 . i ncl udes a ; U S B encoder and a USB decoder. 

20 As one of average skill in the art will ; appreciate, the data stored in memory 16, 

which may have 64 Mbytes or greater of storage, capacity, may be text files, presentation 
files, user profile information for access to varies computer services (e.g., Internet access, 
email, etc.), digital audio files (e.g..' MP3 : .files,. WM A -Windows Media Architecture-, 
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MP3 PRO, Ogg Vorbis, AAC - Advanced ^udio" Coding), digital video files [e.g., still 
images or motion video such as MPEG (motion picture expert group) files, JPEG (joint 
photographic expert group) files, et&Jy Mdrfess- book information, and/or any other type of 
information that may be stored in a digital format. As one of average skill in the art will 
5 further appreciate, when the handheld device^ 1 0 is coupled to the host device A, B, or C, 
the host device may power the handheld device. 10 such that the battery is unused. 

When the handheld device 1 0 is not; coupled to the host device, the processing 
module 20 executes an algorithm 30 to detect the disconnection and to place the handheld 
device 10 in a second operational mode.^ second operational mode, the processing 

10. module 20 retrieves, and subsequently executes, a second set of operational instructions 
from memory 16 to support- the second operational mode. For example, the second 
operational mode may correspond to MP3 file playback, digital recording, MPEG file 
playback, JPEG file playback, text messaging display, cellular telephone functionality, 
and/or AM/FM radio reception. In one;; or more of these operations, the FILCO 31 may 

15 be employed to perform filtering ppdrations. 

In the second operational mode, f: under the control of the processing module 20 
executing the second set of operational instructions, the multimedia module 24 retrieves 
multimedia data 34 from memory 16. . The;. multimedia data 34 includes at least one of 
digitized audio data, digital video data? and text; data. Upon retrieval of the multimedia 

20 data, the multimedia module 24 converts- the: data 34 into rendered output data 36. For 
example, the multimedia module 24 may convert digitized data into analog signals that 
are subsequently rendered audible via a speaker or via a headphone jack. In addition, or 
in the alternative, the multimedia module, 24 may render digital video data and/or digital 
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text data into RGB (red-green-blue) -^UJ/^^ete., data for display on an LCD (liquid 
crystal display) monitor, projection^ on a plasma type display. The 

multimedia module 24 will be described jn greater detail with reference to Figures 2 and 
3. In at least some of these operations; the FIECD 3 1 is employed to filter the digital 
5 data. 

As one of average skill in the art, .the handheld device 10 may be packaged .. 
similarly to a thumb drive, a cellular terephpjic, pager (e.g., text messaging), a PDA, an 
MP3 player, a radio, and/or a digital dictaphone and offer the corresponding functions of 
multiple ones of the handheld devices;.(e.g., provide a combination of a thumb drive and 

10 MP3 player/recorder, a combination of a thumb drive, MP3 player/recorder, and a radio, 
a combination of a thumb drive, MP3 player/recorder, .and a digital dictaphone, 
combination of a thumb drive, MP3 player/recorder, radio, digital dictaphone, and 
cellular telephone, etc.). 

Figure 2 is a schematic block diagram of another handheld device 40 and a 

15 . corresponding integrated circuit 12-1. • In this embodiment, the handheld device 40 
includes the integrated circuit 12- 1 y thejbattery 14, the memory 16, a crystal clock source 
42, one or more multimedia input devices (6.g.,| one or more video capture device(s) 44, 
keypad(s) 54, microphone(s) 46, etc.),. and one or more multimedia output devices (e.g., 
one or more video and/or text display(s) ; 48,?speaker(s) 50, headphone jack(s) 52, etc.). 

20 The integrated circuit 12-1 includes the, host interface 18, the processing module 20, the 

memory interface 22, the multimedia moduia24, the FILCO 31, the DC-to-DC converter 

• . v- . f'r. H i; : 

26, and a clock generator 56, whiclr produces^ a clock signal (CLK) for use by the other 
modules. As one of average skill Yir t^ the clock signal CLK. may 
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include multiple synchronized clock; signal^at;^arying rates for the various operations of 
the multi-function handheld device; . r y-'h 

Handheld device 40 functionsrdma; similar manner as handheld device 10 when 
exchanging data with the host device (i.e.^ when the handheld device is in the first 
5 operational mode). In addition, while in 'the first operational mode, the handheld device 
40 may store digital information recei ved via one of the multimedia input devices 44, 46, 
and 54, Fqrexample, a voice recording received via the microphone 46 may be provided 
as multimedia input data 58, digitized; via the multimedia module 24, and digitally stored . • 

in memory 16. Similarly, video recordings may be captured via the video capture device ~y-f. 

10 44 (e.g., a digital camera, a camcorder; VCR output, DVD output, etc.) and processed by 

the multimedia module 24 for storage as digital video data in memory 16. Further, the — 
keypad 54 (which may be a keyboard, touch screen interface, or other mechanism for 
. inputting text information) provides text data to the multimedia module 24 for storage as 
digital text data in memory 16. In this extension of the first operational mode, the ,;: v r 

15 processing module 20 arbitrates write- access to the memory 16 among the various input 

sources (e.g., the host and the multimeclia module). . 

When the handheld device 40 . is in : 4 the. second operational mode (i.e., not % 
connected to the host), the handheld device may record and/or playback multimedia data 
stored in the memory 16. Note that the data provided by the host when the handheld 

20 device 40 was in the first operational mode , i ncl tides the multimedia data. The playback ' : - • 

of the multimedia data is similar to I he : playback described with reference to the handheld 
device 10 of Figure 1. In this embpdimenty.ilepending on the type of multimedia data 34, 
the rendered output data 36 may be provided- to. one or more of the multimedia output 
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devices. For example, rendered audio rdata- may be provided to the headphone jack 52 
an/or to the speaker 50, while rendered , yideo-and/or text data may be provided to the 
display 48. The handheld device 40, niay {also record multimedia data 34 while in the 
second operational mode. For example, the handheld device : 40 may store digital 
5 ' information received via one of the multimedia; input devices 44, 46, and 54. 

Figure 3 is a schematic block diagram of an integrated circuit 12-2 that may be 
used ina multi-function handheld device. .TKe^ integrated circuit 12-2 includes the host 
interface 18, the processing module 20, the, DC-to-DC converter 26, the FILCO 31, 
memory 60, the clock generator 5,6, ^the. memory interface 22, the bus 28, and the 

10 multimedia module 24. The DC-to-DC converter 26 includes a first output section 62, ^ 
and a second output section 64 to produce a; first and second output voltage (Vddi and 
V0D2), respectively. Typically, . Yppi will -be greater that Vdd2, where Vddi is used to 
source analog sections of the processing module 20, the host interface 18, the memory 
interface 22, and/or the multimedia modulei-22 and Vdd2 is used to source. the digital 

15 sections of these modules. The DCTtQ-DC, converter 26 may further include a battery v % 
charger 63 and a low loss multiple Qutp.ut, stage, 62. The battery charger 63 is operable to 
charge the battery 14 from power it receives .via the physical coupling (e.g., via a USB 
cable) to the host device when the multi^function handheld device is physically coupled 
to the host device. The particular iniprementatioir of the battery charger 63 is dependent 

20 on the type of battery being used and such implementations are-known in the art, thus no 
further discussion will be provided regarding the battery charger 63 except to further 
illustrate the concepts of the present invention. .'' 
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The multimedia module 24 ineludes;an .analog input port 66, an analog to digital 
converter (ADC) 68, an analog ^ut^i^^Tt^ih^gitsA to analog converter (DAC) 72, a 
digital input port 74, a digital output ; $gvt00and an analog mixing module 78. The 
analog input port 66 is operably coupled to receive analog input signals from one or more 
sources including a microphone, an AM/FMi-luner, a line in connection (e.g., headphone 
jack of a CD player), etc. The received analog signals are provided to the ADC 68, 
which produces digital, input data theteiromv%The digital input data may be in a pulse 
code modulated (PCM) format and stored as such, or it may be provided to the processing 
module 20 for further audio processing ^(e.g;,, compression, MP3 formatting, etc.) The 
digital input data, or the processed version thereof, is stored in memory 16 as instructed 
by the processing module 20. 

The digital input port 74 is operably coupled to receive digital audio and/or video, 
input signals from, for example, a digital camera, a camcorder, etc. The digital audio 
and/or video input signals may .be. ^stored^in memory 16 under ; the control of the 
processing module 20. As one of average skill jn the art will appreciate, the audio and/or 
video data (which was inputted as analog signals or digital signals) may be stored as raw 
data (i.e., the signals received are stored as is: in: designated memory locations) or it may 
be stored as processed data (i.e., compressed data, MPEG data, MP3 data, WMA data, 
etc.). "v r I • • 

When the output of the DAC ;72visThe only input to the mixing module 78, the 
mixing module 78 outputs the analog video and/or audio output data to the analog output 
port 70. The analog output portr 7(t.rnay .be coupled to one or more of the speaker, 
headphone jack, and a video display. / The mixing module 78 may mix analog input 
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signals received via the analog input port .6&jyUh the output of DAC 72 to produce a 
mixed analog signal that is provided;.!^ port 70. Note that the buffers in 

series with the inputs of the mixing, moduie- 7 ; 8 may have their gains adjusted and/or 
muted to enable selection of the signals at various gain settings provided to the mixing 

• 5 module 78 and subsequently outputted via the analog output port 70. 

The digital output port 76 is. operably . coupled to output the digital output data 
(i.e., the multimedia data 34 in a .digital format) digital output port 76 may be 

coupled to a digital input of a video display device, another handheld device for direct 
file transfer, etc. -X'] 

10 As one of average skill in the art will appreciate, the multimedia module 24 may 

include more or less components than the ^components shown in Figure 3 or include 
multiple analog and/or digital input and/or output ports. For example, for a playback ; 
mode of digital audio files, the multimedia module 24 may only include the DAC 72 and 
the analog output port 70 that are coupled |o, the headphone jack and/or to the speaker. '.V 

15 As another example, for recording^d^ (i.e., as a digital dictaphone), the 

multimedia module 24 may include.the analog input port 66 coupled to the microphone ^ 
and the ADC. • \ 

Figure 4 is a schematic block diagram illustrating a portion of the integrated 
circuit of Figures 1-3 constructed according to an embodiment of the present invention 

20 illustrating in particular the structure of a filter co-processor 31 and its interaction with 
the processing module 20. As shown,., the processing module 20 is serviced by three 
buses, the X-bus 414, the P-bus 41 8; andUhe' Y-bus 420. SRAM buffers couple to these 
various buses 414, 418, and 420, as/ da^ the* AM 33 and. the FILCO 31. Clock and/or 
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voltage control circuitry 422 operably; couples to both the processing module 20 and the 
FILCO 31. As will be described; further to Figure 6, the clock and/or 

voltage control circuitry 422 may alter the icloek and/or voltage supply to the processing 
module 20 and/or the FILCO 31 to adjust the operation of these devices. 
5 The FILCO 31 includes Fit^O^^fp^ammable registers 400, a FILCO Direct 

Memory Access (DMA) engine and control 402, coefficient register files 404, sample 
register files 406, a Multiply Accumulator; -(MAC) engine 408, and at least one 
accumulator 410. The components of the FILCO 31 are controlled via the processing 
module 20 via the X-bus 414 and the FILCO programmable registers 400. The act of 

10 initiating filtering operations of the FILCO -3 1 by the processing module 20 is referred to 
as a "KICK." In initiating a KICK, .the:- processing module 20 loads the FILCO 
programmable registers 400 to indicate a type of filtering to be performed by the FILCO 
31, identifies location(s) in the RAM 33 of filter coefficients to be used, and identifies 
location(s) in the RAM. 33 of the^ samples^to hbe operated upon. Then, the processing 

15 module 20 directs the FILCO 31 to proceed . with i ts filter operations. .■ 

After the FILCO 31 has been^M]|e^y the processing module 20, the FILCO 
31 operates based upon the directives , it has' received via the FILCO programmable 
registers 400 until it has completed the required, operations. Then, the FILCO 31 writes 
its results to memory 33 and asserts an interrupt U) the processing module indicating that 

20 it has completed the required tasks. In* some, situations, the FILCO 3 1 is required to cease 
its current operations and perform other operations. This interrupting process is referred 
to as an "UNKICK." An UNKICfe -initiated by the processing module 20 or another 
component of the integrated circuit, that- is.- Responsible Tor ensuring that the filtering 
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operations of the integrated circuit are met. Til an UNKICK, the FILCO 31 may save its 
state to memory. Alternately, t^f^G(^^^rrfky simply write over its state, although the 
partial filtering operations that wcre^accompl i shed will be lost. These operations will be 
described further with reference to Figures 5A through 7B. 
' 5 In the construction illustrated in Figure 4, the M AC engine 408 includes a 24x24 

multiplier while the accumulators 410 include; eight (8) 56-bit accumulators. Further, the 
FILCO 31 can operate upon a plurality of samples' at one time, e.g., N-2,3,4,5,6,7,8, 
N. When the FILCO 31 implements a Finite Impulse Response (FIR) filter, the FILCO 
31 implements variable number of taps- that is selected based upon the desired filter, e.g., 
10 0 to 256 or more taps. When the FILCO 3 Ij&f the embodiment of Figure 4 implements .<• % 

an Infinite Impulse Response (IIR) filter; the FILCO 31 implement a fixed number of ^ 
taps, e.g., 5. However, in other embodiments a differing number of taps may be 
employed. 

Figure 5 A is a block diagram ; illustrating audio capture and storage operations . 

15 performed by the integrated circuit.,,. WJth . the , described embodiments, the FILCO 31 

performs filtering operations in both, the; playback mode and in the recording mode. m 
Figure 5 A illustrates one example of the manner in which the FILCO 31 operates while ■ 
the integrated circuit is in the recording mode. In the recording mode the multimedia 
module 24 receives incoming audio information from a microphone 46, for example. An 

20 ADC 68 of the multimedia module . 24, converts the incoming audio information to 
incoming digital audio information, in a Pulse.Qode Modulated (PCM) format according 
to the present invention, which i s stored} > i n a PCM buffer 502. The PCM buffer 502 is 
instantiated in the memory 16, RAM 33,:or:'in ^mother memory servicing the device. 
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The FILCO 31, at the direction of the processing module 20, retrieves the 
incoming digital audio information^ buffer 502 (in memory), and filters the 

incoming digital audio information to produbd^itered incoming digital audio information 
504. The filtered digital audio information is; then written to. a PCM buffer 506, retrieved 
5 by the processing module 20 and encoded according to a supported encoding standard, 
e.g., MP3. The encoded filtered incoming digital audio information is then stored in 
memory 16. In one particular operation of Figure 5 A, the FILCO 31 performs 
decimation filtering on the incoming digital ..audio information to produce the filtered 
incoming digital audio information. . Such ;decimation filtering operations may be 

10 performed at an 8:1 ratio, with three 2:1 filtering operations performed by the FILCO 31 
to achieve the 8:1 decimation process. r _;- - • 

f igure 5B is a block diagram illustrating audio playback operations. In the audio 
playback mode, digital audio information is retrieved from memory 16, operated upon in 
a decoding process 5 1 0 and written to a PCKTbuffer 5 12.. The FILCO 3 1 , at the direction 

15 of the processing module 20, retrieves the^ digital audio information from the PCM buffer 
512 and filters the digital audio information^ filtered digital audio information. 

The filtered digital audio information is then, written to an output PCM buffer 516. A 
DAC 72 of the multimedia module^^ ^ceives the filtered digital audio information from 
the PCM buffer 516 and converts the. filtered, digital audio information to a playback 

20 format, which is output to speaker 50... . : 

The filtering at operation ; ; 5 1 4 performed by the FILCO 31 includes a 1:2 
interpolation filtering on the digital audio. information to produce the filtered digital audio 
information. Further, the FILCO may ■ also .perform . graphic equalization filtering at 
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operation 518 on the digital audio information to produce the filtered digital audio 
information. As will be . described^ : further -Jwith reference to Figures 9 and 10, in 
performing graphic equalization filtering on the digital audio information, the FILCO 31 
performs one of subtractive graphic equalizer filtering in a cascade mode or additive 
5 graphic equalizer filtering in a parallel mode;;:! 

Figure 5C is a logic diagram illustrating operation of the Filter Co- Processor 
(FILCO) of Figure 4. As illustrated,, operation of the FILCO 31 is in an idle 
state/transition state 522. From state 522- the FILCO 31 may be called upon to perform 
FIR decimation filtering (step 524), FIR interpolation filtering (step 544), IIR additive 

10 filtering (step 564), or II R subtractive filtering (step 584). 

When the FILCO 31 is kicked to perform FIR decimation filtering (step 524), the 
processor loads the FILCO programmable registers 402 with configuration directives, 
e.g., type of filter to employ, length of filter,aiuniber of samples to operate upon, starting 
memory location of the filter coefficients, starting mem of the samples to 

15 filter, etc (step 526). The FILCO 31 then- reads, the coefficients from memory and writes 
them to the coefficient register file .404 (step:; 528). Further at step 528, the FILCO 31 
reads the samples from memory and writes; Aheniv. to the sample register file 406. The 
FILCO 31 then performs FIR decimation filtering operations upon the samples using the 
coefficients and based upon the filter configuration 1 loaded into the FILCO programmable 

20 » register 402 (step 530). At step 532, the FILCO 31 determines whether the processing 
module 20 has issued an UNKICK : to fhe ^FILCO 31. If not, operation proceeds to step 
534 where the FILCO 31 determinesl>yhether it has completed the assigned filtering 
tasks. If the filtering tasks are not completed* operation returns to step 530. However, if 
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the FILCO 31 is done with the assigned tasks the results are written to memory 16. 
Alternately, if the FILCO 31 has Hee^ IJNmGKED by the processing module 20, the 
FILCO 31 may or may not save its^ state ^for future reference, depending upon the 
particular embodiment (step 536). ;c, \ 

• -5 . When the FILCO 31 is kicked. to perform FIR interpolation filtering (step 544), 
the processor loads the FILCO programmable; registers 402 with configuration directives 
(step 546). The FILCO 31 then reads the coefficients from memory and writes them to 
the' coefficient register file 404 (step ; 548). ; ; Further at step 548, the FILCO 31 reads the 
samples from memory and writeslhem; to tliev sample register file 406. The FILCO '31 \y^,. 

10 then performs FIR interpolation filtering .operations upon the samples using the .> 
coefficients and based upon the filter .configuration loaded into the FILCO programmable 
register 402 (step 550). At step 5 52 The FILCO 31 determines whether the processing 4 f 
module 20 has issued an UNKICK to the FILCO 3 1 . If not, operation proceeds to step 
554 where the FILCO 3 1 determines ^hqthe^ it has completed the assigned filtering 

15 tasks. If the filtering tasks are not •complete^ However, if 

the FILCO 31 is done with the assigned.., tasks the results are written to memory 16. 
Alternately, if the FILCO 31 has been UNKICKLD by the processing module 20, the ::.y; 
FILCO 31 may or may not save its state; for future reference, depending upon the 
particular embodiment (step 536). . ^ 

20 When the FILCO 31 is kicked to perform IIR additive filtering (step 564), the 

processor loads the FILCO programmable .registers 402 with configuration directives 
(step 566). The FILCO 31 then rqads y the cpefficients from memory and writes them to 
the coefficient register file 404 (step ;|6^). ^Furtiier atstep 568, the FILCO 31 reads the 
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samples from memory and writes ....them? to Jliejsample register file 406. The FILCO 31 
then performs IIR additive filtering using the coefficients 

and based upon the filter configuration Nlqaded tob M the FILCO programmable register 402 
(step 570). At step 572 the FILCO 31 determines whether the processing module 20 has 
5 ' issued an UN KICK to the FILCO , 3 1 . /; lf not, operation proceeds to step 574 where the 

• FILCO 31 determines .whether it has completed the assigned filtering tasks. If the 

filtering tasks are not completed, operation returns to step 570. However, if the FILCO 
31 is done with the assigned tasks the results. are written to memory 16. Alternately, if 
the FILCO 31 has been I JN K I C K ED By t he .processi ng module 20, the FILCO 3 1 may or fer 
10 may not save its state for future reference,' depending upon the particular embodiment 
(step 576). :; - " • ; ■ : . 

When the FILCO 31 is kicked to perform IIR subtractive filtering (step 584), the *■ 
processor loads the FILCO programmable registers 402 with configuration directives 
(step 5686). The FILCO 31 then reads the coefficients from memory and writes them to vx 

>; 15 the coefficient register file 404 (step at step 588, the FILCO 31 reads the % 

samples from memory and writes them to the^ample register file. 406. The FILCO 31 
then performs IIR subtractive filtering operations upon the samples using the coefficients :> 
and the filter configuration loaded into the FILCO programmable register 402 (step 590). 

t At step 592 the FILCO 31 determines, whether; the processing module 20 has issued an 

20 . UNKICK to the FILCO 31. If nqt^operatiori proceeds to step 594 where the FILCO 31 
determines whether it has completed the assigned filtering tasks. If the filtering tasks are 
not completed, operation returns to '.step '5 96:; However, if the FILCO 31 is done with the 
assigned tasks the results are written to memory 16. Alternately, if the FILCO 31 has 
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been UN KICKED by the processing mQdule 20, the FILCO 31 may or may not save its 
state for future reference, dependingup^ embodiment (step 596). 

The pipelining of data through the; use of eight accumulators 410 and the 
sample/coefficient register files 402 and 404 helps reduce the number of DMA accesses 
5 - by re-using samples and coefficients efficiently. Instead of reading all N taps and 2N 
samples per output sample pair generated, the FILCO 31 reads (N taps + # of zero 
fill*) and 2N samples for four* output /sample impairs generated. For FIR interpolation 
operations, three zero fills are required. .; Fop FIR operations, six zero fills are 

required. This decreases the load^-oii the ;DMA bus 412 helping overall system 

1 0 performance. ' 5 ' - v v,7- 

Figure 6 is a logic diagram illustrating system interaction with the FILCO of 
Figure 4. Operation commences durhig noniial system continuing operations (step 602). 
When a FILCO 31 operational swap, is required (step 604), e.g., from 1IR additive 
filtering to FIR decimation filtering, the processing module 20 determines whether an 

15 UNKICK is required (step 606). - . ; If :a)^^KIGK is required, the processing module 20 
issues an UNKICK command to the' fmC&;2 Instep 608) and resultantly the FILCO 31 
responds to the UNKICK command by yNKICKing its operations, in some cases also 
with saving its state (step 610). Frpin bpth srep 610 and if an UNKICK is not required 
(as determined at step 606), operation •.proceeds to step 612 wherein the processing 

20 module 20 loads the FILCO programmable registers 400 -with the desired filtering 
configuration information (step 6 1 2). -The processing module 20 then KICKS the FILCO 
3 1 to initiate the new filtering operations.; - , 
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A context switch (step 604) : m^y result when a buffer underflow condition is 
detected during a playback mode .Qp'eration. . In such case, the buffer cannot become 
vacant. Thus, if the processing module 20. detects such an underflow condition, it will 
KICK the FILCO 31 to perform the required, filtering operations. Alternately, during a 

r 5 recording mode operation a buffer overflow condition may be detected. In such case, the 
processing module 20 detects the overflow -condition and may KICK the FILCO 31 to 
perform required filtering operations. : - ; ; ' 

In some operations, e.g., playback , mode, idle mode, etc. the full processing 
capabilities of the FILCO 31 and/or the processing module 20 are not required. In such 

10 case, the processing module 20 (or another -integrated circuit component) detects that 
excess filtering capacity exists considering current filtering requirements (step 620). In 
such case^ the clock frequency provided to the FILCO 3 1 and/or processing module 20 is 
reduced. Alternately, the supply voltage provided to the FILCO 3 1 and/or the processing 
module 20, is reduced. . > rV :; . 

15 When the supply voltage r loiXh^}F}]LCO 31 has been reduced and/or the clock 

frequency provided to the FILCO 3 Land/or the: processing module 20 has been reduced, 
a filtering capacity shortfall may be detected .(step 624). When this shortfall is detected, 
the supply voltage and/or the clock frequency provided to the FILCO 31 and/or the 
processing module 20 is increased (step 6 10). 

20 Figure 7A is a logic diagram illustrating Finite Impulse Response (FIR) filtering 

operations of the FILCO of Figure-^jv^peirati^h commences with the processing module 
20 KICKing the FILCO 31 to perforni the FIR; filtering operations (step 524 or 544 of 
Figure 5). The processing, module 20 then Jo^ds the FILCO configuration registers 400 
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(step 526) and the FILCO DMA engine ; 402 reads memory 16 to access the filter 
coefficients and samples that are to :/bb, filtered (step 528). The FILCO 31 then sets a 
word count to the number of words to be operated upon in the FIR filtering process. 

For the particular MAG operations: to be .performed the coefficients are grabbed 

75 (step 702), the samples are grabbed (step 704;);.and a MAC operation is performed (step 
706). With the particular MAC operation performed it is next determined whether the 
last coefficient has been operated upon for the current sample(s) (step 710). If not, it is 
next determined whether the next M#G: -operation requires only new sample(s) (step 
708). If so, operation proceeds to step 704. , J f both coefficients and samples are required 

10 (as determined at step 708), operation proceeds To. step 702. 

From step. 710 operation proceeds to, step; 7 1 2 wherein the FILCO 31 outputs the 
result of the MAC operations to memory. Then, the FILCO 31 determines whether the 
word count for the FIR operations has reached zero, i.e., the operations are complete for 
the current KICK (step 714). . If so,, the operations are completed, the FILCO 31 sets an 

15 interrupt indicating that its operations- are, complete and the KICK is cleared (step 716). 
If not, operation proceeds to step 718,,where ;the start pointers are incremented and the 
word count is decremented. Then,, .the ;,FIL£0 31 determines whether it has been 
UNKICKED by the processing mpdule, 2() (step 720). If not, operation returns to step 
702. If so, the FILCO 31 saves its state and de^asserts^he KICK (step 722). From step 

20 • 722, operation proceeds to step 522 of Figure ;5.:. 

• - y -■ ' J 

* .. *.S • • • • .«. .-• 

Figure 7B is a logic diagram, illustratmg Infinite Impulse Response (IIR) filtering 
operations of the FILCO of Figure 4.; , Operation commences with the processing module 
20 KICKing the FILCO 31 to perform the TIR: filtering operations (step 564 or 584 of 
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Figure 5). The processing module 20:thenjoads the FILCO configuration registers 400 
(step 566) and the FILCO DMA .engine, .402- reads memory 16 to access the filter 
coefficients and samples that are to be filtered; (step 568). The FILCO 31 then sets a 
word count to the number of words to be operated upon in the IIR filtering process. 

For the. particular MAC operations to be performed the coefficients are grabbed 
(step 752) and the samples are grabbed (step .75.4). The FILCO 31 next determines 
whether a parallel (additive) IIR mode is to be used (step 756). If the FILCO 31 is 
operating in the parallel mode, the FILCO 31 gets and stores the output Y(n) (step 760). 
If the FILCO 31 is no operating in the parallel mode, from step 756 operation proceeds to 
step 758 (as it does from step 760). : . 

At step 758, the FILCO 31 performs^ a MAC operation to determine 1 1(n) (step 
758). The FILCO 31 then determines. again whether the parallel (additive) IIR mode is 
used (step 762). If the parallel mode is being, used, the FILCO 31 calculates H(n) = Y(n) 
+ I I(n) (step 766). If the FILCO, 3 1, is riot operating in the parallel mode, operation 
proceeds to step 764 as if does from /stgp'766 where the FILCO 31 writes H(n) to a 
specified output. The FILCO 31 then shifts M(n) and H(n-l) to a specified location (step 

768). . ^ . ;;y v.;^Vj : , 

The FILCO 3 1 next determines, whether the word count for the IIR operations has 
reached zero, i.e., the operations are coin pi etc lb r the 1 current KICK (step 770). If so, the 
operations are completed, the FILCO ,3T sets an interrupt indicating that its operations are- 
complete and the KICK is cleared • (step 772).-: If not, operation proceeds to step 774 
where the start pointers are incremented^ and the word count is decremented. Then, the 
FILCO 31 determines whether it has been UN K ICK ED by the processing module 20 
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(step 776). If not, operation returns , i6 ;jstep;^2; If so, the FILCO 31 saves its state and 
de-asserts the KICK (step 778). Fixim :step : 7:7„8, operation proceeds to step 522 of Figure 

Figure 8 A is a block diagram illustrating one structure of a FIR filter employed by 
. 5 the FILCO of Figure 4. The FIR filter includes a plurality of delay elements 802, a 
plurality of gain elements 804, and a plurality ;df summers 806. The FIR filter of Figure 
8 A has K taps. • ' 

Figure 8B is a block diagram <I1 lustrating one structure of an IIR filter employed 
by the FILCO of Figure 4. The IIR filter is of J a Bi-Quad design and includes a plurality 
10 of sample buffers 852 and a plurality of multipliers 854 that multiply the plurality of 
samples stored in the sample buffers 852 by filter coefficients bo, b|, hi. A summer 862 
receives the outputs from the multipliers 854 and also outputs from multipliers 857. 
Multipliers 857 produce outputs based upon contents of output sample buffers 859 and 
coefficients ai and d^. The output of the. summer 862 is produced to multiplier 856, 
1 5 which multiplies the output by a scaHn^ produce an output sample at buffer 858. 

An IIR gain is applied to the output sample buffer 858 contents to produce results of the 
IIR filter that are stored in memory. FILCO supports Bi-Quadratic IIR filter modes for 
both additive and subtractive graphic equalizer implementations. 

Figure 9 is a block diagram illustrating IIR filtering operations of the FILCO of 
20 Figure 4 in a cascade mode of operation; With the subtractive mode equalizer (IIR filter) 
a single buffer 902 is used for mult i.p I e .passes f o f each stage/band, of the equalizer. Each 
time the bi-quad filter is run to process a band, both the input and the output are set to 
point to the same circular buffer for operation by the BLQuad filter 904, 906, etc. The 
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filter coefficients are set for the ^S^V^^^an^ the filter is KICKed off, The filter 
coefficients for this case are set for hbfch Tiltering- i : e. potentially reducing the amplitude 
of any frequency components within its pass band, Out-of-band frequency components 
are essentially unmodified. Thus, frequency comppnents within the band are effectively 

'5 "subtracted" from the composite signal; This is counter intuitive to what is displayed on 
the user interface of a graphic equalizer :but - an effective implementation technique. For 
the final filter/channel bank run for the equalizer 908, one can choose to point the results 
back in to the same buffer for in-place computation or one can vise this filter operation to 
also copy the result to another circular buffer-;91 : 0: (as illustrated > 

10' : .' • , ■ • • ■ ' .' • 

Figure 10 is a block diagram illustrating IIR filtering operations of the FILCO of 
Figure 4 in a parallel mode of operation. The K -band additive graphic equalizer model of 
Figure 4 uses a different operation uppn%pirt%ufer 1 002 samples. In this case, each IIR 

15 filter operation 1004, 1 006, 1 008; ^fO^O^s set as a band pass filter so that the 
frequency components outside of its pass .band are strongly suppressed. Using gain 
elements 1012, 1014, 1016, . . . , 101 8 the components lying inside a pass band are 
copied to the output buffer 1022 where The components from all banks are super 
positioned with the summation operator 1020. / This form of the equalizer (IIR filter) is 

20 used when all bands are computed in parallel; :and results are simultaneously available 
from all filter banks 1002. - 

In the parallel mode, each filter .bank isijrun as a separate KICK. For a five-bank 
equalizer there are five separate IIR filters to run and each IIR filter 1004-1010 runs to 
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completion before the next one is started; ; In parallel mode, just as a filter output sample 
is computed, it is added to the value :: jn; : :the^output sample array 1022. Thus the 
superposition of all filter banks is fo rmed j ri the - output buffer 1022 where all filter results 
for a given sample are added together. 

The preceding discussion has presented a host interface for a system-on-a-chip 
integrated circuit. As one of average, skill in -the art will appreciate, other embodiments 
may be derived from the teaching of the. present invention, without deviating from the 
scope of the claims. •:• .■ ' ; T 



